Effects of apparent image velocity and complexity on the dynamic visual field using a high-speed train driving simulator

Train driving is a highly visual task. The visual capabilities of the train driver affects driving safety and driving performance. Understanding the effects of train speed and background image complexity on the visual behavior of the high-speed train driver is essential for optimizing performance and safety. This study investigated the role of the apparent image velocity and complexity on the dynamic visual field of drivers. Participants in a repeated-measures experiment drove a train at nine different speeds in a state-of-the-art high-speed train simulator. Eye movement analysis indicated that the effect of image velocity on the dynamic visual field of high-speed train driver was significant while image complexity had no effect on it. The fixation range was increasingly concentrated on the middle of the track as the speed increased, meanwhile there was a logarithmic decline in fixation range for areas surrounding the track. The extent of the visual search field decreased gradually, both vertically and horizontally, as the speed of train increased, and the rate of decrease was more rapid in the vertical direction. A model is proposed that predicts the extent of this tunnel vision phenomenon as a function of the train speed.Relevance to industryThis finding can be used as a basis for the design of high-speed railway system and as a foundation for improving the operational procedures of high-speed train driver for safety.     

Does thermal control improve visual satisfaction? Interactions between occupants’ self-perceived control,visual, thermal,and overall satisfaction

Occupants’ satisfaction had been researched independently related to thermal and visual stimuli for many decades showing among others the influence of self-perceived control. Few studies revealed interactions between thermal and visual stimuli affecting occupant satisfaction. In addition, studies including interactions between thermal and visual stimuli are lacking different control scenarios. This study focused on the effects of thermal and visual factors, their interaction, seasonal influences, and the degree of self-perceived control on overall, thermal, and visual satisfaction. A repeated-measures laboratory study with 61 participants running over two years and a total of 986 participant sessions was conducted. Mixed model analyses with overall satisfaction as outcome variable revealed that thermal satisfaction and visual satisfaction are the most important predictors for overall satisfaction with the indoor environment. Self-perceived thermal control served as moderator between thermal satisfaction and overall satisfaction. Season had slight influence on overall satisfaction. Random effects explained the highest amount of variance, indicating that intra- and interindividual differences in the ratings of satisfaction are more prevalent than study condition. Future building design and operation plans aiming at a high level of occupant satisfaction should consider personal control opportunities and take into account the moderating effect of control opportunities in multimodal interactions.     

Capturing Preservice Chemistry Teachers’ Visual Representations of Redox Reactions through Storyboards

This study aimed to identify preservice chemistry teachers’ understanding of redox reactions at the submicroscopic level and how they make connections to macroscopic level. Twenty‐five preservice chemistry teachers first viewed a video of a redox reaction happening between a zinc wire and a copper(II) sulfate solution, then they reflected on their macroscopic observations, and generated storyboards (a sequence of drawings) representing this reaction at the submicroscopic level. Both the reflections and the storyboards were coded, and the categories reflecting the participants’ levels of understanding were determined. Results showed that the participants usually identified the macroscopic evidences, but they had conceptual difficulties in interpreting and representing evidences at the submicroscopic level. Few participants indicated a scientific or a moderate understanding of redox reactions, whereas the majority exhibited either weak or alternative understanding of redox reactions.     

A novel approach for efficient stance detection in online social networks with metaheuristic optimization

In the 19th and 20th centuries, social networks have been an important topic in a wide range of fields from sociology to education. However, with the advances in computer technology in the 21st century, significant changes have been observed in social networks, and conventional networks have evolved into online social networks. The size of these networks, along with the large amount of data they generate, has introduced new social networking problems and solutions. Social network analysis methods are used to understand social network data. Today, several methods are implemented to solve various social network analysis problems, albeit with limited success in certain problems. Thus, the researchers develop new methods or recommend solutions to improve the performance of the existing methods. In the present paper, a novel optimization method that aimed to classify social network analysis problems was proposed. The problem of stance detection, an online social network analysis problem, was first tackled as an optimization problem. Furthermore, a new hybrid metaheuristic optimization algorithm was proposed for the first time in the current study, and the algorithm was compared with various methods. The analysis of the findings obtained with accuracy, precision, recall, and F-measure classification metrics demonstrated that our method performed better than other methods.     

Face Recognition Based on Gabor Feature Extraction Followed by FastICA and LDA

Over the past few decades, face recognition has become the most effective biometric technique in recognizing people’s identity, as it is widely used in many areas of our daily lives. However, it is a challenging technique since facial images vary in rotations, expressions, and illuminations. To minimize the impact of these challenges, exploiting information from various feature extraction methods is recommended since one of the most critical tasks in face recognition system is the extraction of facial features. Therefore, this paper presents a new approach to face recognition based on the fusion of Gabor-based feature extraction, Fast Independent Component Analysis (FastICA), and Linear Discriminant Analysis (LDA). In the presented method, first, face images are transformed to grayscale and resized to have a uniform size. After that, facial features are extracted from the aligned face image using Gabor, FastICA, and LDA methods. Finally, the nearest distance classifier is utilized to recognize the identity of the individuals. Here, the performance of six distance classifiers, namely Euclidean, Cosine, Bray-Curtis, Mahalanobis, Correlation, and Manhattan, are investigated. Experimental results revealed that the presented method attains a higher rank-one recognition rate compared to the recent approaches in the literature on four benchmarked face datasets: ORL, GT, FEI, and Yale. Moreover, it showed that the proposed method not only helps in better extracting the features but also in improving the overall efficiency of the facial recognition system.     

End-to-end multimodal affect recognition in real-world environments

Automatic affect recognition in real-world environments is an important task towards a natural interaction between humans and machines. The recent years, several advancements have been accomplished in determining the emotional states with the use of Deep Neural Networks (DNNs). In this paper, we propose an emotion recognition system that utilizes the raw text, audio and visual information in an end-to-end manner. To capture the emotional states of a person, robust features need to be extracted from the various modalities. To this end, we utilize Convolutional Neural Networks (CNNs) and propose a novel transformer-based architecture for the text modality that can robustly capture the semantics of sentences. We develop an audio model to process the audio channel, and adopt a variation of a high resolution network (HRNet) to process the visual modality. To fuse the modality-specific features, we propose novel attention-based methods. To capture the temporal dynamics in the signal, we utilize Long Short-Term Memory (LSTM) networks. Our model is trained on the SEWA dataset of the AVEC 2017 research sub-challenge on emotion recognition, and produces state-of-the-art results in the text, visual and multimodal domains, and comparable performance in the audio case when compared with the winning papers of the challenge that use several hand-crafted and DNN features. Code is available at: https://github.com/glam-imperial/multimodal-affect-recognition.     

Multi-label,multi-task CNN approach for context-based emotion recognition

This paper proposes a new deep learning architecture for context-based multi-label multi-task emotion recognition. The architecture is built from three main modules: (1) a body features extraction module, which is a pre-trained Xception network, (2) a scene features extraction module, based on a modified VGG16 network, and (3) a fusion-decision module. Moreover, three categorical and three continuous loss functions are compared in order to point out the importance of the synergy between loss functions when it comes to multi-task learning. Then, we propose a new loss function, the multi-label focal loss (MFL), based on the focal loss to deal with imbalanced data. Experimental results on EMOTIC dataset show that MFL with the Huber loss gave better results than any other combination and outperformed the current state of art on the less frequent labels.     

基于边缘和局部熵融合的视觉安全性评估方法

针对基于局部熵进行加密图像视觉安全性评估存在块效应的局限性，引入图像的边缘特征，通过共有边缘来衡量加密图像与原始图像的边缘相似度，消除了块效应。由于局部熵对加密等级低的图像不敏感，边缘相似度对加密等级高的图像不敏感，将两个评估方法进行自适应融合，提出[SLEES]（Local Entropy and Edge Similarity，[SLEES]）指标。通过改变图像像素位置和图像像素值的加密方式处理图像和视频帧进行测试，实验结果表明，[SLEES]指标相比传统评估指标有更好的鲁棒性，评估范围更广。     

基于条件信息卷积生成对抗网络的图像识别

传统的图像识别方法需要大量有标签样本进行训练，且模型训练难以达到稳定。针对这些问题，结合条件生成网络和信息最大化生成网络的结构优势建立了条件信息卷积生成网络（C-Info-DCGAN）。模型增加图像的类别信息和潜在信息作为输入数据，然后利用Q网络去更好地发挥类别信息和潜在信息对训练的引导作用，并且利用深度卷积网络来加强对图像特征的提取能力。实验结果表明，该方法能够加快模型训练收敛速度，并有效提高图像识别的准确率。     

Autonomous industrial assembly using force,torque, and RGB-D sensing

ABSTRACT

We present algorithms and results for a robotic manipulation system that was designed to be easily programable and adaptable to various tasks common to industrial setting, which is inspired by the Industrial Assembly Challenge at the 2018 World Robotics Summit in Tokyo. This challenge included assembly of standard, commercially available industrial parts into 2D and 3D assemblies. We demonstrate three tasks that can be classified into ‘peg-in-hole’ and ‘hole-on-peg’ tasks and identify two canonical algorithms: spiral-based search and tilting insertion. Both algorithms use hand-coded thresholds in the force and torque domains to detect critical points in the assembly. After briefly summarizing the state of the art in research, we describe the strategy and approach utilized by the tested system, how it's design bears on its performance, statistics on 20 experimental trials for each task, lessons learned during the development of the system, and open research challenges that still remain.